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Abstract 

This paper studies the set of n x n matrices for which aU row and 
column sums equal zero. By representing these matrices in a lower dimen- 
sional space, it is shown that this set is closed under addition and multipli- 
cation, and furthermore is isomorphic to the set of arbitrary (n— 1) x (n— 1) 
matrices. The Moore-Penrose pseudoinverse corresponds with the true 
inverse, (when it exists), in this lower dimension and an explicit repre- 
sentation of this pseudoinverse in terms of the lower dimensional space is 
given. This analysis is then extended to non-square matrices with all row 
or all column sums equal to zero. 

1 Introduction 

In various areas of mathematics, one comes across matrices where all row and 
column sums are constrained to equal zero. Examples arise in coding theory, 
stochastic processes, statistics and many other areas where linear algebra is used. 
Particular examples are the rate matrices of doubly stochastic, continuous time, 
finite-state Markov chains, the quadratic covariation matrices of any finite-state 
Markov chain (for example [2]) and the 'Laplacian matrices' of graph theory. 
One problem which arises when studying these matrices is that their inverses do 
not exist: the vector with all elements one is an eigenvector with corresponding 
eigenvalue zero, so the determinant of these matrices will be zero. This supports 
reference to alternative definitions of the inverse, the most common being the 
Moore-Penrose (pseudo- ) inverse . 

The Moore-Penrose inverse has interesting properties in this context, which 
are derived in this paper. The primary result is that the set oinxn matrices for 
which all row and column sums equal zero is isomorphic to the set of arbitrary 



{n — 1) X [n — 1) matrices, with a modified product operation. Under this 
isomorphism, the Moore-Penrose inverse maps to the true inverse when it exists, 
and to a modified Moore-Penrose type inverse when it does not. Using this, 
expHcit formulae can be given for the Moore-Penrose inverse, and the range of 
the projection operator X^X exphcitly described, for X a rank n — 1, n x n 
matrix with all row and column sums equal to zero. 

2 Preliminary Ideas 

We denote by M„ the set of all n x n matrices with components lying in a field 
F, which we shall assume to be of characteristic zero. The canonical example 
which we shall discuss is the real matrices; however, the analysis can easily be 
extended to the complex matrices. We denote by S'„ the subset of matrices 
for which all row and column sums are equal to zero. For any matrix A, a 
pseudoinverse is any matrix which satisfies 

AA+A = A. 

If furthermore A'^ satisfies 

A+AA+ = A+ 
A+A = {A+A)* 
AA+ ^ {AA+y, 

where [.]* denotes the conjugate transpose, it is said to be the Moore-Penrose 
(pseudo)inverse of A. It is well known that the Moore-Penrose inverse of any 
matrix A exists and is unique (see, for example, [4]). If A is invertible then 
= A^^ is the only pseudoinverse, and if A has a left- or a right-inverse then 
this will be the Moore-Penrose inverse. A good general treatment of generalised 
inverses can be found in [T]. 

3 Representation 

Theorem 3.1. There is a bijection <f) between Sn+i and M„, given by the map 

4> ■■ Mn —> Sn+l,X ^ J*XJn 

where 

J„ := [/„|-1], 

an identity matrix with a column o/ — 1 's added to the right hand side. 

Proof. Consider an element X of Sn+i- As all the row sums are zero, that is, 
for any i, e*Xei — 0, we know that 

n 

e*+iXei = - ^ e*Xei. 

Similarly 

n 

e*Xen+i = - ^ e*Xej 
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for all i. Therefore, if X G M„ is the submatrix of X excluding the {n + l)th 
row and column, we know that 



e*Xen+i = - e*Xej = -e*Xl, 



and similarly for the rows of X. 

Therefore, for any X G S'„, we have the relationship 



X = 



X 


-x\ ' 


\*x 


1X1 



= JnXJn = 4>{X). 



This establishes the surjectivity of (/). Injectivity follows from the fact J„ is 
right-invertible. □ 

Corollary 3.2. If X = J*XJn. then X and X have the same rank. 

Proof. Jn is right invertible, and so no degrees of freedom are lost under this 
transformation. □ 

Corollary 3.3. X ^ X* if and only if X = X* . 

Proof. It is clear that 

= (Jn-X'-^n)* ~ Jn^* Jm 

the result follows as J„ is right invertible. □ 

Remark 3.4. It is clear that the choice of placing the column of — I's on the right 
hand side of J„ is arbitrary, and that this column can equivalently be placed 
elsewhere. This will not change the value of J„ J*, and so the following analysis 
will be unchanged. Similarly a set of matrices with other linear dependencies 
could be considered, with the following holding mutatis mutandis. 

Theorem 3.5. // x denotes standard matrix multiplication and o denotes the 
'twisted' product X oY — XKnY , Kn :~ JnJnj where X and Y are in Mn, 
then (j) is an isomorphism between the rings (S'„+i,+, x) and (Af„,+,o). 



Proof. Suppose 



We have 
and 



X — J*XJn, 

Y — J^YJji. 

X + Y = J*[X + Y]Jn 
XY = J*XJ,,J*YJ„ = rXK^YJn, 



where Kn := JnJn- It is then clear that XY has a representation J*(X_ft'„F) J„. 
By Theorem 13. 11 this implies that Sn is closed under addition and matrix mul- 
tiplication and hence forms an algebraic ring. □ 
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We now extend our definition of the Moore-Penrose inverse to the ring 

{Mn, +, o) by replacing each instance of matrix multiplication by the o opera- 
tion. For notational clarity, we shall denote a classical inverse X~^, a. classical 
Moore-Penrose inverse X+, an inverse under o by and a Moore-Penrose 
inverse under o by X®. 

Theorem 3.6. (/) maps all pseudoinverses under x to pseudoinverses under o. 

In particular it preserves the Moore-Penrose inverse. 

Proof. We simply check that = J*X®Jn satisfies the required properties 
for a (Moore-Penrose) pseudoinverse whenever X® satisfies the requirements 
under o, and vice versa. □ 

Note that Kn has a simple form, namely 



K — J J* — 



with inverse 



n + 1 



2 1 

1 2 

1 1 

n 



n 



-1 -1 



e Mn 



n 



Theorem 3.7. The ring {Sn+-L,+, x) has a unique multiplicative identity 



1 



n+ 1 



'-(n+l)x(n+l)) 



where 1 



(n+i)x(n+i) here denotes the matrix with all entries 1. (This differs from 

the usual matrix identity In+i ^ Sn+i-) 

Proof. Under the operation o, is clearly an identity element and is unique 
(as Kn has a unique inverse). Hence it is the unique identity in (M„, +, o) and 
therefore in {Sn+i, + , x) by isomorphism. 

This fact could also have been observed directly, as the vector with all entries 
one is the only vector in the left and right null spaces of every matrix in Sn+i ■ CH 



4 Pseudoinverses 

We now move to the key result of this analysis - a representation of the Moore- 
Penrose pseudoinverses of matrices in Sn+r- 

Theorem 4.1. For any rank n matrix X in Sn+i, the Moore-Penrose inverse 
of X is the unique pseudoinverse of X in Sn+i, and is given by 

where X = J*XJn- 
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Proof. In this case, X G Sn+i is of rank n and has representation J*XJn. It is 
clear that X is of full rank, and so has a unique inverse in (M„, +, o), that is, a 
matrix X^ such that 

XoX^ =X^ oX^R-^. 

Inspection shows that this corresponds to the regular inverse of X through the 
formula 

X^ = K-^X-^K-\ 

As (M„,+,o) and (S'„+i,+, x) are isomorphic (by Theorem 13. 5p . and X^ 
is the (Moore-Penrose) inverse of X in M„, this leads to the Moore-Penrose 
inverse of X having a representation 

X'^ = J*X'^Jn — Jn^n ^^n 

by Theorem 13.61 □ 
Corollary 4.2. For any rank n matrix X in Sn+i, we have 

XX^ = X^X = J*K ^Jn = 1,1+1 — rl(«+i)x(n+i) 

n + 1 

and hence X^ acts as a true inverse in Sn+i- 

Now suppose that X G Sn+i is of rank < n, and has representation J*XJn. 
Clearly X will have multiple pseudoinverses in (M„, +, o), as it is of incomplete 
rank. To find the Moore-Penrose inverse of X, we wish to find the Moore- 
Penrose inverse X® under o. Expanding the conditions for a pseudoinverse, 
along with our earlier result for rank n matrices, suggests an inverse of the form 
K~^X~^K~^. Unfortunately this does not satisfy the symmetry requirements 
under o, (and will give a different pseudoinverse). 

Provided we are dealing with real or complex matrices, we know that Kn 
is symmetric and positive definite and therefore has a Cholesky decomposition 
Kn = knk*, where fc„ is an invertible, lower triangular n x n matrix (in fact, 
we can use any square matrix /c„ with Kn ~ 

Theorem 4.3. For any real or complex matrix X = J*XJn G Sn+i, the Moore- 
Penrose inverse of X lies in Sn+i, is equivalent to the Moore-Penrose inverse 
of X in {Mm +, o) and is given by the equations 

X^ = Jj^{k^^) {k^Xkn)'^k^^ Jn 

and 

X+ = J* \im{X*KnXKn + 6I)-^X*Jn. 
sio 

Proof. Expanding K^^ and Kn using the decomposition Kn — A:„fc*, we find 
that the matrix 

{kn ) {kn^kn)^k^ 

will satisfy the requirements for the Moore-Penrose inverse. This is done in full 
in the more general non-square case below. 
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As a Moore-Penrose inverse can be expressed as the limit of a perturbed 
solution (see, for example, [3]), we also have the following useful formula 

= \im{klX*Kr,Xkr, + 5kl{k-^yk-^kr,)-^klX*kn 
<5X0 

— 1 TA* J 



and so 



\iTnk-\X*KnX + 6K-^)-^X*k„ 

5X0 



(/c-i)*(fc:Xfc„)+fc-i = YimK-\X*Kr,X + <5i^-i)-iX* 



\\m.{X*KnXK„ + Siy^X*. 

5i0 



□ 



5 Non-square matrices 

This methodology can be applied to give explicit results for Moore-Penrose 
inverses for other types of matrices. We now consider the case for real or complex 
X, where X has all row and column sums equal to zero but we do not assume 
that X is square. 

Using the same logic as above, we can write X as 

for some m and n, where X will now be an m x n matrix. We again define 
Km = JmJm = KaKn ^"i Upper triangular and invcrtible. 

Theorem 5.1. For X = J*^XJn, X'^ is given by 

X^ — Jn{kn^) {k^-^Xkn)^k^n Jm- 

Proof. Inspection verifies that all these matrices are conformable so we need 
only verify that this formula satisfies the assumptions for the Moore-Penrose 
inverse. 

XX^X = J„jX J„ J„(fc„ "'") {k^Xkn)^k^^ JmJm^Jn 

— Jm-^^nkn{kn^) {k^^X kn)'^ k^^ k^k^X Jn 

X^XX^ — J^{k^^) {k^Xkn)^k^JraJ„i^JnJn{kn^) [k^Xkn)'^ k^^ J,n 

— Jn{kn ) {k-m-^kn)^ k^ Jm 

[xx+r = ij:,xj„j:{k-'nk*^xk„)+k-'jmr 

— {Jm-^ kn{kjj^X kn)^ k^^ Jm) 

— {J-mikm) (fc„jXfc„)(fc„Xfc„)^fc„j^ Jm) 

— Jm{km ) [kmX kn){k^X kn)^ k^^ Jra 

and the final condition follows as the third. Therefore, the conditions for the 
Moore-Penrose inverse are satisfied. □ 
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We can also deal with (possibly non-square) matrices where only the row 
sums are equal to zero (or equivalently, where only the column sums are equal 
to zero). In this case we have the representation 

X — XJn 

with Jn as before. This gives the following. 

Theorem 5.2. Let X = XJn, with X a left-invertible matrix. Then the Moore- 
Penrose inverse of X is given by 

x+ - j:k-^x+. 

Proof. As X is left-invertible, X^X = I. Therefore 

X{J*K-'X+) = XJnJ*K-'X+ 

= XX+ 

{J*K-'X+)X = J^K-'X+XJn 
— J* K'^ T 

both of which arc symmetric. It is clear that 

XJ*K-'X+X = XJnJ*K-'X+XJn = XJn = X 

and 

j:k-'x+xj:k-^x+ - j:K-'x+xjnJ:K-^x+ = j:k-'x+. 

Hence J^I^^^X^ satisifes all the requirements for the Moore-Penrosc inverse of 
X. □ 

Theorem 5.3. Let X = J^X , with X a right- invertible matrix. Then the 
Moore-Penrose inverse of X is given by 

X+ =X + K-^Jn. 



Proof. This follows as in Theorem 15.21 □ 



6 Extra Zero Rows 

A particular example of interest is for X e Sn+i, where X is of rank m and 
contains n — m rows and columns which are invariably zero. An example of such 
a matrix with n = 3, m = 2 is 

"10 1 

3 0-1 

-4 

This can be written through the linear transformation 

1 

1 



-1 -1 



7 



-2 
-2 



3 



1 
1 



^2,{3} 



J'. 



2.{2}, 



where J2,{3} refers to the J2 matrix as defined above, with an additional column 
of zeros inserted into the third place. 

For any Jm,a, where a lists the columns where zeros are inserted, 

J T* — K 

Theorem 6.1. For a fixed a with m entries, m < n, let S^^i be the set of 
(n + 1) X (n + I) matrices with all row and column sums zero, and with zeros 
in those rows and columns listed in a. Then there exists an isomorphism 

</) : (M„_„.,+,o) ^ {S^+i,+, x),X^ j;,_^XJ„^a 

where X oY = XK^Y as before. 

Proof. The proof of this follows exactly as for Theorem 13.51 □ 

Theorem 6.2. The Moore-Penrose inverse of X — J^]^XJm,a, where X is of 
rank m, is given by 

Proof If 
then 

We can see that if X is of rank m, so is its equivalent mxm matrix X. Therefore, 
this has a true inverse. Using the fact that Jm.aJm a — Jm,hJ*nh ~ ^rm we 
can then expand the definition of the Moore-Penrose inverse to give the desired 
result. □ 

Remark 6.3. Note that this theorem does not require that X is square, as a and 
b can list different numbers of positions where zeros are inserted. 

We can, therefore, establish the following general property for all matrices 
of this form. 

Theorem 6.4. For X ~ J*^ \^XJm,a of rank m, 

X^ X = Jm,a-^m Jm,]aJm,h-^ Jri,a 

— 1* J 

7 A final fact 

A final useful result is that, for matrices of this form, ii X = J*^ ^^XJm.a is of 
rank m, then 



Y+ Y J* 1 T 

^ ^ — ^m,a-'^m •■'m.a 



J* 



m + 1 



Tm.a' 



where Imxm again refers to a matrix with all entries one. 
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Theorem 7.1. Let M be any matrix with m rows, and X any rank m square 
matrix of the form X = bXJm,SL- If M = J^^^M, then 

X+XM = M. 

Proof. We have 

X+XM = r^^^K;^^j^,^r^^^M = r^^^K-^KmM = m. 

□ 

Considering this form of M , it is clear that these are the matrices with col- 
umn sums of zero and with zeros in the rows denoted by a, that is, corresponding 
to the columns of zeros in X. 

Theorem 7.2. The vectors of the form M = Jm,a.M form an m- dimensional 
subspace spanning the range of the projection operator X+X. 

8 Conclusion 

We have examined some of the properties of matrices with all row and column 

sums equal to zero, particularly in relation to their Moore-Penrose inverses. The 
set of these matrices is isomorphic to the set of matrices of smaller dimension, 
which easily shows that they form a ring with identity and gives general results 
for the calculation of the pseudoinverses within this ring. Wc have shown that 
the true inverse in this smaller ring, if it exists, corresponds in some sense to 
the Moore-Penrose inverse for the original matrices. If we consider the subset of 
matrices with the extra restriction that a certain number of rows and columns 
are zero, then a further explicit formula for the projection operator X+X can 
be obtained, which characterises its range. These results have applications in 
the theory of Markov chains and other areas. 
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